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Abstract. We consider integer-restricted control of systems governed by ab- 
stract semilinear evolution equations. This includes the problem of optimal 
control design for certain distributed parameter systems endowed with multi- 
ple actuators, where the task is to minimize costs associated with the dynam- 
ics of the system by choosing, for each instant in time, one of the actuators 
together with ordinary controls. We consider relaxation techniques that are 
already used successfully for mixed-integer optimal control of ordinary differen- 
tial equations. Our analysis yields sufficient conditions such that the solution 
of the relaxed problem can be approximated with arbitrary precision by a solu- 
tion satisfying the integer restrictions. The results are obtained by semigroup 
theory methods. The approach is constructive and gives rise to a numerical 
method. We supplement the analysis with numerical experiments. 



1. Introduction and Problem Formulation 

The factoring of decision processes interacting with continuous evolution plays 
an important role in model-based optimization for many applications. For example 
when laying out a chemical reactor, among determining continuous variables such 
as modeling inlet and outlet concentrations for maximizing extraction rates, the 
number of reaction columns or restrictions to standard equipment sizes versus its 
costs become key considerations. Such mixed-integer optimal control problems are 
therefore studied in different communities with different approaches. Most of these 
approaches address problems that are governed by systems of ordinary differential 
equations in Euclidean spaces, sec [17] for a survey on this topic. 

Total discretization of the underlying system obviously leads to typically large 
mixed-integer nonlinear programs. Hence, relaxation techniques have become an 
integral part of efficient mixed-integer optimal control algorithms, either in the 
context of branch-and-bound type methods or, more directly, by means of nonlinear 
optimal control methods combined with suitable rounding strategies. An important 
result is that the solution of the relaxed problem can be approximated with arbitrary 
precision by a solution fulfilling the integer requirements [16]. 

In this paper, we extend such relaxation techniques to problems that arc governed 
by certain systems of partial differential equations. Motivating applications are for 
example to switch between reductive and oxidative conditions in order to maximize 
the performance in a monolithic catalyst [22], port switching in chromatographic 
separation processes [5, 11], or to optimize switching control within photochemical 
reactions [20]. Our problem setting also includes the switching control design in 
the sense that systems are equipped with multiple actuators and the optimizer has 
to choose one of these together with ordinary controls for each instant in time. 
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Concerning systems involving partial differential equations, such switching con- 
trol design has already been studied using several techniques: In [14, Chapter 8] 
optimal switching controls are constructed for systems governed by abstract semi- 
linear evolution equations by combining ideas from dynamic programming and ap- 
proximations of the value function using viscosity solutions of the Hamilton- Jacobi- 
Bcllman equations. Switching boundary control for linear transport equations using 
switching time sensitivities has been studied in [8] . Exemplary for the heat equation 
and based on variational methods, the controllability in case of switching among 
several actuators has been considered in [23] and null-controllability for the one- 
dimensional wave equation with switching boundary control has been considered in 
[7]. Based on linear quadratic regulator optimal control techniques and enumera- 
tion of the integer values for a fixed time discretization, optimal switching control 
of abstract linear systems has been considered in [10]. 

Our approach is complementary to the above, as we break the computationally 
very expensive combinatorial complexity of the problem by relaxation. This comes 
at the downside of providing only a suboptimal solution but, as we will see, with 
arbitrary small integer-optimality gap, depending on discretization. 

We will be concerned with the following problem of mixed-integer optimal con- 
trol: Minimize a cost functional 

J = Hy(tf))+ I f L(y(t),u(t))dt (1) 
Jo 

over trajectories y: [0,i/] — > X and control functions [u, v] : [0,t/]->C/xV subject 
to the constraints that y is a mild solution of the operator differential equation 

y(t) = Ay(t)+f(t,y(t),u(t),v(t)), t £ (0,t f ] 
2/(0) = y eX ( ' 

and that the control functions satisfy 

u(t) G C/ad C U, v(t) G Kd C V, t G [0,t f ] (3) 

where X, U and V arc Banach spaces, A: D(A) — s- X is the infinitesimal generator 
of a strongly continuous semigroup {T(t)} t >o on X, tf > is a fixed real number, 
/: [0, tf] x X x U x V — >• X, (j): X — ¥ R and L: X x U -> R are given functions, 
Uad is some subset of U and 14d is a finite subset of V. 

We will refer to the above infinite-dimensional dynamic optimization problem 
as mixed-integer optimal control problem, short (MIP), and to the control function 
[u, v] as a mixed-integer control. This accounts for the fact that we do not impose 
restrictions on the set C/ a( j C U while we can always identify the finite set 14d C V 
of the feasible control values for v with a finite number of integers 

V ad = {v\...,v N }c{l,...,N}. (4) 

Moreover, the operator differential equation (2) is an abstract representation of 
certain initial-boundary value problems governed by linear and semilinear partial 
differential equations, see, e.g., [15]. 

The existence of an optimal solution of the problem (MIP) depends, inter alia, 
on the spaces where we seek u: [0, tf] — > U x V and v: [0, t/] -» V. Common 
choices are, for u,v respectively, L 2 (0,tf,U), piecewise C k (0,tf,U) or (piecewise) 
H k (0,tf,U) for u and L°°(0, £/;VQ or the space of piecewise constant functions 
with values in V for v. We defer these considerations by assuming later that there 
exists an optimal solution of a related (to a certain extent convcxificd and relaxed) 
optimal control problem and present sufficient conditions guaranteeing that the 
solution of the relaxed problem can be approximated with arbitrary precision by a 
solution satisfying the integer restrictions. 
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This relaxation method becomes most easily evident from writing problem (MIP) 
using a differential inclusion, that is, minimize (1) subject to the constraints that 
y is a solution of 

fm^Mt) + {f(*,y(f)Mt),'o i )--v i ev Bd }, te(0,f/] 

and u satisfies 

u{t) e U ad , te[0,t f }. 

It is well known, that under certain technical assumptions, the solution set of (5) 
is dense in the solution set of the convcxified differential inclusion 

(y(t)eAy{t)+co{f{t 7 y(t),u(t) 7 v l ):v l £V ad }, t e (0,t f ] 

\ 2/(0) = yo, 

where co denotes the closure of the convex hull. This is proved in [6] for the case 
when X is a separable Banach space and in [4] for non-separable Banach spaces. 
While these results rely on powerful selection theorems, our main contribution is 
a constructive proof based on discretization, giving rise to a numerical method at 
the prize of additional regularity assumptions. 

We will see that the advantage of such a relaxation method is that the convexificd 
problem, using a particular representation of (6), falls into the class of optimal con- 
trol problems with partial differential equations without integer-restrictions. The 
already known theory, in particular concerning existence, uniqueness and regu- 
larity of optimal solutions as well as numerical considerations such as sensitivities, 
error analysis for finite element approximations, etc., can thus be carried over to the 
mixed-integer problem under consideration here. The disadvantage of this approach 
is that we target at a solution that is only suboptimal (though with arbitrary preci- 
sion) and that switching costs, a standard regularization of mixed-integer problems 
to prevent chattering solutions, or additional combinatorial constraints can lead to 
larger optimality gaps. Nevertheless, we will show how a-priori bounds for such a 
gap can be obtained when constraints on the number of switches are incorporated. 

The framework we use for the analysis here will be semigroup theory. Recall 
that for given yo £ X and given control functions u, v, the mild solution of the 
state equation (2) is given by a function y £ C(0,tf,X) satisfying the variation of 
constants formula 

y(t)=T(t)y + f T(t-s)f(s,y(s),u(s),v(s))ds, 0<t<t f (7) 
Jo 

in the Lebesgue-Bochner sense. This abstract setting covers in particular the usual 
setup for weak solutions of linear parabolic partial differential equations with dis- 
tributed control on reflexive Banach spaces where A arises from a time-invariant 
variational problem, sec [1, Section 1.3]. 

Throughout the paper we denote by Hp W (0,tf,X) the space of X-valued func- 
tions defined on the interval [0,i/] and being piecewise once- weakly differentiable 
with a piecewise defined weak derivative that is square-integrable in the Lebesgue- 
Bochner sense. Consistently, we denote by Cp^(0,tf } X) the space of X-valued 
functions defined on the interval [0,tf] being piecewise Holder-continuous with a 
Holder-constant In both constructions, piecewise means that there exists a finite 
partition of the interval [0,f/] 

= r < n < r 2 < . . . < t k < T K +i = t f (8) 

so that the function has the respective regularity on all intervals [Tfc,Tfc+i), k = 
0, . . . , K . We denote by || • \\x the norm on X and by || • \\c(X) the operator norm 
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induced by || • For simplicity of notation, we also define T(—t) = Id for all 
t > 0, Id denoting the identity on X. 

The paper is organized as follows. In Section 2, we present details of the relax- 
ation method sketched above. In Section 3, the main result concerning an estimate 
of the approximation error is presented. In Section 4, we discuss extensions of the 
method to incorporate certain combinatorial constraints. In Section 5, we discuss 
applications for linear and semilinear equations and present numerical results for 
the heat equation with spatial scheduling of different actuators and a semilinear 
reaction-diffusion system with an on-off type control. In Section 6, we conclude 
with some additional remarks and point out open problems. 



2. Relaxation Method 

Consider the following problem involving a particular representation of the con- 
vexified differential inclusion (6) 

rtf 

minimize J = c/)(y(tf)) + / L(y(t),u(t)) dt s.t. 

Jo 

N 

y(t) = Ay(t) + «*(*)/(*, y(t), u{t),v% t E (0, t f ] 

i=l 

2/(0) = 2/o 

(9) 

U{t) G t/ad, te [Q,tf] 

a{t) = («!(*),..., ajv(t)) e [0,1]* te [0,t f ] 

N 

E°*(*) = 1 > *G [0,*/]. 

t=l 

Observe that the control functions a, take values on the full interval [0, 1], but 
that any optimal solution [u*,a*] of (9) yields an optimal mixed-integer solution 



(10) 



of problem (MIP) if a*{t) E {0, 1} N for almost every t € (0,*/). 

However, it is not very difficult to construct examples where a*(t) E (0,1)^ 
for t on some interval of positive measure. It is only in some special cases where 
optimality of a*(t) E [0, 1]^ implies that a* takes only values on the boundary of its 
feasible set. For examples where this property, known as the bang-bang principle, 
can be verified in the context of partial differential equations, see [21, Section 3.2.4] 
and the references therein. 

Therefore, under the main hypothesis 

(Ho) Problem (9) has an optimal solution [u*,a*] 

we propose an iterative procedure in Algorithm 1 below to obtain from a* a control 
taking only values in {0, 1}^ and show in Theorem 1 under additional technical 
assumptions that the solution of problem (MIP) can be approximated by this pro- 
cedure with arbitrary precision. 
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Algorithm 1. 

1: Choose a time discretization grid Q = {0 = Vq < t\ < ■ ■ ■ < tz, a = tf} and 

some termination tolerance e > 0. Set k = 0. 
2: Find a relaxed optimal control [it*, a*] : [0,t/] — > [/ x [0, 1]^ of (9) with a 

corresponding trajectory y* and set J* = J(u*,a*,y*). 

3: LOOP 

4: Using £ fe , define a function uj k = . . . , w^) : [0,i/] -> {0, 1}^ piece- 
wise constantly by 

^(t)=p^, te[t?,*ti) (ii) 

where 

fc _ J 1 if > pf j for all Z ^ j and j < I with p£ s = pf; - 
Pj,i ~ | else 

(12) 

fc 



/ ,+1 aj (r) iT-X)pJ,l(*ti-*f)- 
5: Set J fc = (/)(y k {t f )) + f* f L{y k {t) lU *{t)) dt where y k is the solution of 

N 

y(t) = Ay(t) + Y,"i(t)f(t,y(t),U*(t),v i ), *G(0,*/] 

i=l V 

2/(0) = y G X 



6: If J fc < J* + e then STOP. 

7: Choose G k+1 = {0 = < < ■ • • < = t f } such that Q k C 

£ fe+1 and set fc = fc + 1. 
8: END LOOP 

9: Set V*(t) = (*)«*> * e [M/]- 

□ 

Theorem 1. in addition to the main hypothesis (Ho), assume that the following 
assumptions hold true. 
(Hi ) The functions <j) '■ X — > M and L : X x ?7 — > K are continuous. Moreover, the 
function f satisfies the Lipschitz- estimate 



\f(s,y 1 ,u*(s),v z ) - f(s,y 2 ,u*(s),v t )\\ < L\\yi - y 2 \ 



x 



with a constant L uniformly for t £ [0, t/] a. e., i = 1,...,N and J/i G 3^1 = 
{y*(t) : t G [0,*/]}, y 2 € y 2 = {y(t) : t G [Q,tf], y solves (9) for some a G 

L-(o,t /; [o,in}. 

(H2) For all i = 1, . . . , N and t £ [0,f/] £/ie function 

s^T(t-s)f( S ,y*( S ),u*(s),v l ) 
is in Hp W (0, tf, X) and there exists a positive constant C{ such that 



^-T(t-s)f(s,y*(s),u*(s),v i ) 



< Ci, for a. e. < s < t < tf. 

x 



LetC = J2? =i a. 



(H3) For all i = 1, . . . , N, there exists a positive constant Mi such that 



sup \\f(t,y*(t),u*(t),v l )\\ x <Mi 

t€[0,t f ] 



Let M = YhLi M i- 
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Moreover, assume that the sequence {G k }k is such that {At k }k with 

At k = max {t*-t*_i} (14) 

is strictly monotonically decreasing. Then Algorithm 1 terminates in a finite num- 
ber of steps with a feasible solution [u* ,v*\ of Problem (MIP) satisfying the estimate 

\J* - J{u*,v*)\ <£. (15) 

Remark 1 . The proof of Theorem 1 in Section 3 in fact yields the estimate 

\Vf{t)-y k (t)\\ x < {{M + Ct)e^ Lt )(N-l)At k , t€[0,t f ], (16) 

where M = sup tg [ t/ ] ||T(i)||£(x) and the constants M,C and L are given by 
hypothesis (H 2 )-(H 3 ). This proves a linear dependency of the integer-control ap- 
proximation error in terms of the chosen maximal control discretization mesh size 
At k . Moreover, assuming that in addition to (Hi), there exists a constant r\ such 
that 

I0(m) -^(2/2)1 < r\h)\ ~V2\\x, yi,V2^X (17) 
and a function £ G L 1 (0,t/) such that 

\L( yi ,u*(t))-L(y 2 ,u*(t))\<at)\\yi-y2\\x, VUV2&X (18) 
then one obtains from (16) by standard estimates the following error bound 

\J* - J([u*,v*})\ < Lc{t f ) + J' e(t)C(t) dt\ (N - l)At fc , (19) 

with C(t) = (AI + Ct)e MLt . This shows again a linear dependency of the error on 
the chosen maximal control discretization mesh size At k . 

In a similar fashion, the method can also deal with state constraints. Suppose 
that we wish to include a constraint of the form 

G(y(t),t)>0, te[0,t f ] (20) 

in the mixed- integer optimal control problem (MIP). Including this constraint also 
in (9) and assuming continuity of the function G: X x [0, tf] — > K, then (16) yields 
that the constraint violation of the integer solution satisfies 

\G(y*(t),t)-G(y k (t),t)\<e (21) 

for k sufficiently large. Moreover, if we assume that there exists a function ( € 
L°°(0,tf) such that 

\G(y u t)-G(y 2 ,t)\<((t)\\ yi -y 2 \\ x , yi,y 2 eX (22) 

then (16) yields that 

\G(y*(t),t)-G(y k (t),t)\ < C(t)C(t)(N - l)At k (23) 

with C(t) as in (19). This shows again a similar linear dependency on At k . The 
assumption (22) holds for example for functions G enforcing time-periodicity con- 
straints 

y(t f ) = y(o), (24) 

occuring, e.g., in chromatographic separation processes [5, 11]. 

Remark 2. Algorithm 1 requires in step 2: to solve a relaxed optimal control prob- 
lem without integer constraints. We note that the conclusion of Theorem 1 remains 
true if we replace the main hypothesis (Ho) by 

(H ) Problem (9) has a feasible solution [it*, a*]. 
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and, accordingly, waive the optimality of [it*, a*] stipulated in step 2: of Algo- 
rithm 1. An important case, for instance, is when the control functions [u*,a*] 
found in step 2: satisfy only local optimality conditions. This can still be useful 
in order to provide bounds for the mixed integer-problem (MIP). Nevertheless, an 
approximation of a globally optimal solution of problem (MIP) can of course only 
be obtained when the problem in step 2: is solved to global optimality. 

Moreover, the problem in step 2: can in practice only be solved numerically 
and may therefore require further discretization, e.g., using the method of lines 
by means of a finite-element semi-discrctization in space. Suppose that such a 
discretization is well-posed in the sense that 

\\vm-V*(t)\\x<C(h)\\y*\\x, te[0,t f ] (25) 
for a constant C(h) — > as h —> 0, where y* h is the solution of the discretized 
problem parameterized by h. The conclusion of Theorem 1 then again remains 
true if the control functions [u*, a*] are obtained by means of a sufficiently small 
h. We then have the estimate 

hi® - y k (t)\\x < WvW) - V*(t)\\x + \\y*(t) - y k (t)\\x (26) 
and see, from (16) in Remark 1 and (25) that 

\\ y *(t)-y k (t)\\x^0 (27) 

for (h, At k ) -> 0. 

Remark 3. In order to solve the optimal control problem (9) numerically and in view 
of Remark 2, the problem may have to be (adaptively) discretized. In particular, 
direct or indirect numerical methods may be used. For an introduction to the basic 
concepts see, e. g. , [9] . Depending on the method of choice for the time discretization 
of the control function it: [0,f/] — > U it may in many cases be advantageous to 
discretize u and v on the same grid Q k and to move step 2: into the main loop of 
the algorithm with 

3': Find a relaxed optimal control [u k ,a k ] : Q k — >• U x [0, 1]^ of (9) with a corre- 
sponding trajectory y* and set J* = J(u k ,a k ,y*). 
along with another termination criterion 

3": If u k {t) := a k {t) e {0,1} for t 6 [0,*/], then STOP, 
preceding step 4:. Then the conclusion of Theorem 1 still holds if the optimal 
relaxed solution J* is frozen after a finite number of iterations k max by setting 
y* = y(u km **, a femax ) and J* = J(w femax , a femax , y*). This is implemented in the 
software package MS MINTOC designed for solving mixed-integer optimal control 
problems with ordinary differential equations [18, 17]. 

Clearly, hypothesis (H2) of Theorem 1 imposes additional regularity assumptions 
on the linear operator A generating the semigroup {T(t)} t >o, the function /, but 
also on the admissible time regularities of the control functions u: [0, tf] — > U and 
v: [0,tf] — > V or a: [0,tf] — > [0,1]^, respectively. The main difficulty is that y* 
as a solution of (7) with A unbounded may only be continuous and not absolutely 
continuous in time, hence not necessarily diffcrentiable almost everywhere as this 
is always true when A = (with T(-) = Id) and A is a finite dimensional space. A 
little more can be said for linear systems 

y(t)=Ay(t) + f(t,u(t),v(t)), y(0) = y a (28) 

when / is sufficiently smooth. 

Remark 4. Consider the problem (MIP) with equation (2) replaced by (28), let 
M = sup te [ t/ ] HlX^l^pf) and suppose that the functions g l : [0,tf] —> X defined 
by g l {t) = f{t, u*(t),v z ), i = 1, . . . , N, satisfy the following conditions 



8 



FALK M. HANTE AND SEBASTIAN SAGER 



(i) g l (t) £ D(A) for a. e. t £ [0,i/] and there exists constants L l such that 
csssu Pte[at/] WAg^t) \\ x <L\ (29) 

(ii) g l is differentiable for a. e. t £ [0, t/] and there exist constants C % such that 

< C\ (30) 

x 

Then, because of condition (i) we get from the chain rule that 

±T(t - s)g(t) = T(t - s) ±g(t) -T(t- s)Ag(t) (31) 

for all i = 1, . . . , N and thus, by taking the norm, applying the triangular inequality 
and using the definition of the constants from above 

< M (& + L l ) . (32) 

x 

So hypothesis (H 2 ) of Theorem 1 holds with d := M [C l + L l ). The conditions 
(i) and (ii) are a natural extension of the differentiability assumptions imposed in 
[16, Corollary 6] for the case when A = and X = R n . 

We further discuss hypothesis (H2) in Section 5 for linear and scmilinear systems 
exemplary for cases when A is the generator of an analytic semigroup. 

3. Proof of Theorem 1 



ess sup te[ot/] 



We prove the following result. 



Lemma 1. Let e > and M = sup tG [ 0)t j ||T(i)||£(jf)- Suppose that [u*,a*,y*] is 
a feasible solution of the relaxed problem (9) and assume that the hypotheses (Hi)- 
(H3) of Theorem 1 hold true. Let u) = (u>\, . . . , ojn) £ L°°(0,tf,[0,l] N ) be such 
that 



max sup 

i=l,...,JV te[0>t/ ] 



< £ 



and let y be the mild solution of (13) with ujf = cjj, i = 1, . . . , N. Then 



\\y*(t)-y(t)\\x < {(M + Ct)e 



(33) 



(34) 



forte [0,t f ]. 



Proof. Fix t £ [0,tf] and set, for the sake of brevity, S(t) = \\y*(t) — y(t)\\x- 
Recalling (8), let {tq,ti, . . . ,tk+i} be the set of partition points of the functions 



a ^ T(t-s)f(s,y*(s),u*{s),v i ) £ Hi(0,t f ;X), i 



,N, assumed in (H2). 



From the definition of the mild solutions to (9) and (13), we have 



m 



N 



J2 / T(t-s)f(s,y*(s),v i )a*(s)-T(t-s)f(s,y(s),v i )u; i {s)ds 



x 



Adding = T(t - s)f(s,y*(s),v i )u} i {s) - T(t - s)f{s,y*( S ) 7 v t )uj l {s) under the 
integral, applying the triangular inequality and rearranging terms this yields 

S(t)<T / T(t-s)[f(s,y*(s),v i )-f(s,y(s),v i )]uJ i (s)ds 

.•— 1 •'O 



X 



N 

E 

»=i 



K 

E 

k=0 J Tk 



i~k + i 



T(t- s)f(s,y*(s),v l )[a*(s) - uii(s)]ds 



x 
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Now using integration by parts in the second part, we obtain 
i=i Jo 

N K / fT k+ l 

+ E E [T{t-T k+ i)f{T k+ uy*{T k+l )y) / aJ( a )- Wi ( fl )dfl 

4=1 fe=0 V " / ° 

-T{t-T k )f{T k ,y*{r k ),v i ) / (*«*(«) da 

./o 

r k + 1 d 



ds 



(T(t~s)f(s,y*(s),v 1 )) / alW-UiWddds 



x 



Then by rearranging terms, noting that 

^2(T{t-T k+1 )f{T k+1 ,y*(T k+1 ),v l ) I a*(s) -Ui(s)ds 



k=0 



~T{t-T k )f{T k ,y*{ Tk )y) / at{s)-Ui{s)ds 



= f{t,y*{t)y) / a*(s)-C0i(s)ds 
Jo 

because of terms canceling out, T(t — t) = Id and J ° cc*(i?) — dd = 0, and by 
applying the triangular inequality this estimate simplifies to 

S(t) <J2 W T (t- s)\\ L(x) \\f(s, y*(s), «*) - f(s, y(s), »*)||xK(*)| 
i=i J o 

+ ^||/(t,y*(t)X)L / aJ(«)- Wi (s) 
<=i Jo 



ds 



N r t 



E 



£(T(f -*)/(*, !,*(*),«*)) 



A" 



ds. 



Then, by definition of the constant M, the definition of the constants L, C and 
71/ in hypotheses (Hi)-(H3), the assumption (33) and the fact that u)i(t) < 1, this 
yields 

S(t) < ML [ S(s) ds + Me + Cte. 



Finally, using the Gronwall lemma and rearranging terms, we obtain the desired 
estimate 

A/Lt N 



5(t) < ((71/ + Ct)t 



□ 



Moreover, in order to prove Theorem 1, we use a recent result on integral ap- 
proximations. 

Lemma 2. (Theorem 5 of [16]) Let a = (ax, . . . , ajy) : [0, i/] — > [0,1]^ be a 
measurable function satisfying X}j=i a i{t) = 1 f or a ^ t G [0, £/] . Let a function 



oj: [0,tt] — ¥ {0,1} be defined piecewise constantly by 

Uj(t) =Pj,i, t <E [U,t i+ i) 



(35) 
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where = to < ti < • • • < t n = tf, 

if Pj,i _ ^ Pl,i f or a H ' 7^ J an d 3 < I with jjjj = pi : 
else 

i— 1 



Pj,i = 



(36) 



,(t) dr -^p jt i(tt +1 -t{). 



1=0 



a(r) - Wj(r) 



< (iV - l)At, 



TTien it holds 

(1) max 

i=l,...,JV 

N 

(2) ^Wi(t) = 1 for allt G [0,*/], 

i=l 

where At = tnaxi=i n {tj — £j-i}. 

With the above two results we are now in the position to prove Theorem 1. 

Proof of Theorem 1. Let the assumptions of Theorem 1 hold true. First observe 
that any control [u*, v*] obtained by Algorithm 1 is feasible for the problem (MIP), 
because u* is feasible by assumption and v*(t) = ^ i=l ^i{t)v l , t G [0, tf], by 
construction in step 4:, where u>f(t) £ {0,1} for all i,k and t € [0,f/] as seen 
from (11) and (12). Then suppose that the main loop in Algorithm 1 terminates 
in step 6:. Then, the termination criterion J? < J* + e and step 9:, recalling the 
bijection (10), implies that \ J* — J(u*,v*)\ < e. Next suppose that Algorithm 1 
loops infinitely many times, that is, 



\Jk - J*\ > e, for all k = 1,2,... 

and consider J k = \J£ — J*\ as a sequence of k. From Lemma 2 with a 
uj = oj k and At = Atk with Atk from (14), we get that 



max 

i=l,...,N 



a*(r)-^(r)dr 



< (N — l)At k , t € [0,t f ]. 



Then Lemma 1 used with uj = u> k and y — y k implies that 



\\y*(t) - y k {t)\\ x < ( (M + Ct)e MLt ) (N - l)At k , t G [0,t f ] 



(37) 



(38) 



(39) 



The assumption that At k is a strictly monotonically decreasing sequence together 
with the continuity assumptions on <f> and L due to (Hi) then implies that J k = 



| Jl — J* | , because 



J* 



Hyk(t f ))-^y*(t f )) 



L(y k (t),u*(t)) - L(y*(t),u*(t))dt 



is also a strictly monotonically decreasing sequence. This contradicts (37) and 
completes the proof. □ 



4. Combinatorial Constraints 
Suppose we wish to include combinatorial constraints of the form 



(40) 



into the mixed-integer optimal control problem (MIP) given by (l)-(3), where 
#« i rvuJ ( v ) denotes the number of switches of the control function v. [0,tf] — > V a d 
from value v l to value Vj, K 1 ^ are given, non-negative constants and I, J C 
{l,...,iV}. 
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Note that the relaxation method considered in Section 2 typically satisfies 

for some i, j € {1, . . . , iV} as we let e — ?> 0, so eventually violating (40) for small e. 
Therefore, along the lines of [19], we propose a modification of Algorithm 1, where 
we replace steps 4: and 6: by 

4': Using Q k , define the function uj k = (uj k , . . . , oj%) : [0,tf] — > {0,1}^ piecewise 
constantly by 

(41) 



where py* is given by the solution of the min-max problem 



min J su b(p ) = max max 

i = 1 , • • • j^V r—X , . . . 



'=1 



subject to 

Yl \Pi,r - Pj,r+l\ < KUJ i iel, jeJ 



(42) 



r=l 
N 



^Pi,r = l, r=l, 



with Atf 



tf, i = 1, 



p v e{0,l}, i = l,...,JV, r = l,...,n fe 
n k , and 

8& = i f' +1 a*(t)dt, i=l,...,N, 1 = 1,. 
6': If \J suh {p k -*) - J m b(j> k - 1 '*)\ <eork> fc max then STOP. 



(43) 



The min-max problem (42) can be written as a standard mixed-integer linear 
problem (MILP) using slack variables and can be computed efficiently [19]. We 
then have the following result. 

Theorem 2. Suppose that the hypotheses of Theorem 1 hold true. Let M = 
sup tg [ t/ ] ||T(t)||£pf) and C(t) = (M + Ct)e MLt , the constants M,C and L given 
by (H2)-(Hs). Then the Algorithm 1 with steps 4: and 6.- replaced with 4'.- and 6';, 
respectively, terminates for every e > and fc max > with a feasible solution [u* , v*] 
of problem (MIP) satisfying the combinatorial constraints (40) and the estimate 



\\y*(t)-y k (t)\\x<C(t)(j suh ( P k >*) + 5) 



At*. 



for some < 5 < max ;=1 

//, in addition to (Hi), there exists a constant r\ such that 

l0(2/i) - ^(2/2) I < v\\vi - yzWx, 2/1,2/2 e x 

and a function £ £ 1^(0, i/) such that 

\L( yi ,u*(t)) - L(y 2 ,u*(t))\ < m\\yi ~ y*\\x, 2/1,2/2 €X 
then the following estimate holds 

\J* -J([u*,v*})\ < Lc{t f )+ Z(t)C(t)dt\ (J sub (p M )+5) 

with the same 6 as in (44). 



(44) 

(45) 
(46) 

(47) 
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Proof. Algorithm 1 with steps 4: and 6: replaced with 4': and 6':, respectively, 
terminates after k steps, k < k max , with controls [it*,u*]. The control u* is feasible 
for problem (MIP) by assumption. From (41) and the constraints in (42) we see that 
u)j(t) £ {0, 1} for all t £ [0,tf] and thus, by step 9: in Algorithm 1 and recalling the 

bijection (10), the control V*(t) = ^2iLi (t)v l , t £ [0,tf] is feasible for problem 
(MIP). The constraints in (42) also ensure that the combinatorial constraints (40) 
arc satisfied. Moreover, the cost function in (40) is defined as 



Jsub(/'*) 



max max 

i=l,...,N r =l,...,n 



i=i 



By definition of in (43) and 0J k {t) in (41) and rearranging terms, we get 



max max 
i=l,...,JVr=l .... ,n 



Using that a*(t) £ [0, 1] and G {0, 1} for all t £ [0,t f ], this yields 



<Wp M ) 



max sup 

te[o,t/] 



«?W-w?(t) dr 



(48) 

(49) 

(50) 
S we 



for some < 8 < max ;=lj n k Atf. Applying Lemma 1 with e = J su b{p 
get that 

\\y*(t) - y k (t)\\ x < (M + Ct)e aLt (J suh (p k n + S) (51) 

with the constants M,C and L given by (H2)— (H3). By definition of C(t), this 
proves (44). The estimate (47) then follows from (44) using the definition of the 
cost function J in (1) and the Lipschitz-cstimates (45) and (46). This completes 
the proof of Theorem 2. □ 

Remark 5. As already remarked in the case without combinatorial constraints, 
the method can also deal with state constraints such as (20). Assuming again 
existence of a function £ G L°° (0, £/) such that (22) holds true, (44) yields a bounded 
deviation of the feasible reference trajectory 



\G{y*(t),t) - G{y k {t),t)\ < t(t)C(t)(J suh (p«>*) + 5), 



(52) 



and hence a bound on the worst case constraint violation. Remark 2 and Remark 3 
apply similarly. 



5. Examples 

In this section we discuss the hypothesis (Hi)-(H3) of Theorem 1 exemplary for 
a linear and a semilinear control problem where A is the generator of an analytic 
semigroup and present numerical results for a test problem in each case. 



5.1. A linear parabolic equation with lumped controls. Let fl be a domain 
in M™ and fi : — > M, i — 1, . . . , N, be fixed control profiles. Consider the internally 
controlled heat equation 



PZ^g-siXit) = fa(t){x)u{t), inQ 
3=1 J 



y(x, t) = 0, on S 

. y(x,o) = yo(x), in n 

where Q = SI x (0,tf), S = <9f2 x (0, £/) and p is a positive constant. 



(53) 
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Suppose the control task is to minimize the cost function 



J 



\y(t f ,x)\ 2 dx + A] 



\y{t,x)\ 2 dxdt + A 2 / \u(t)\ 2 dt (54) 



where y is the weak solution of (53) by selecting u: [0,tf] — > K and a switching 
signal cr(-): [0,tf] — > {1, . . . , N} determining the control profile fa applied at time 
t€[0,t f ]. 

In order to write the above problem in abstract form (2), we let X = L 2 (Vt), 
set V = U = U ad = R, V ad = {1,...,N} and define /: [0,*/] x U x V -> X 
by f(t,u,v)(x) := } v {x)u, (j)(y) = \\y\\ 2 x , L(y,u) = Xi\\y\\ 2 x + \ 2 \u\ 2 and define 
(A, D(A)) as 



d(A) = H 2 {n)oHl{n) 

dx 



(Ay)(x) = J2^(x), yeD(A). 



(55) 



j= i —j 

It is well-known that (A, D(A)) is the generator of a strongly continuous (analytic 
semigroup of contractions {T(t)} t >o on X, see, e.g., [15]. 

Let [u*,a*] be a feasible solution of the relaxed and convexified problem (9) 
Assume that these feasible controls [it*, a*] satisfy 

[u*,a*] e HL r (0,T)xL°°(p,T) N 



and that the fixed control profiles fa satisfy 

fi G D(A) for all i = 1,...,N. 



(56) 



(57) 



We now want to check if the assumptions (Hi)-(H3) of Theorem 1 are satisfied. 
The continuity assumptions (Hi) for <f> and L and / clearly hold. From semigroup 
theory and the chain rule we get, using (57) 

±T(t-s)f(s, u*(s), v l ) = T(t - s)^-f(s, u*(s), v l ) - T(t - s)Af(s, «*(«),«*) (58) 
ds ds 

for all i = 1, . . . , N. By taking the norm in (58), applying the triangular inequality 
and using that {T(t)} t >o is contractive, i.e., ||T(t)||£pn — 1 f° r au t > 0, we have 



ds 



T(t-s)f( S ,u*(s),v l ) 



< 



r/.s 



f(s,u*(s),v* 



\Af( s ,u*(s),v*)\ 



x 



X 



Thus hypothesis (H 2 ) holds, because 



-/(*,«•(*),«*) 



A' 



< \\M 



X 



X 



d *( \ 
dS u (s) 



< oo 



and 



\\Af{t,u*{t)y)\\ x < \\AM x \u*(t)\ < oo 
due to assumption (57). Also, observe that 

sup \\f(t,u*(t),v l )\\ x < H/flljcKWIloo < oo, 
te(o,t f ) 



(59) 

(60) 

(61) 
(62) 



because u* is at least piecewise continuous by assumption. 

Thus, by Remark 2, we can conclude that Algorithm 1 terminates in a finite 
number of steps with a feasible mixed- integer solution [u*, v*] satisfying the estimate 
\J(u*,v*) — J(u*,a*)\ < e. Moreover, by Theorem 1, if [u*,a*] is the optimal 
solution of the relaxed and convexified problem (9), then the integer-gap of [u*,a*] 
and the optimal mixed-integer solution [it*, v*] is less or equal than e. The desired 
switching structure a: [0, tf] — > {1, . . . , N} is finally given by a(t) = v* (t). 
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Example 1. To demonstrate the applicability of the approach, we implemented 
Algorithm 1 for a test problem of the form (53)-(54) with a two-dimensional rect- 
angular domain and the following parameters. 

Let ft = [0, L^] x [0, L^\, = 1, = 2 and tf = 15 and suppose that there are 
given 9 actuator locations Xi with the positions given by ^) € f2, where 

6 _^o« Sifc _» ± Mg ! ii i . t = 123 (63) 

Further suppose that there is a point actuator for each of these locations X{ which 
we model here by setting /; = Bi with 

Bi(x) = -L=e~ l °*' )a (64) 



/2ne 

for some small, but fixed e > 0. Note that 



B l (x)dx = l (65) 

Q 

and that Bi(x) converges to the Dirac delta function 8(x — Xi) as e — > 0. 
As initial data we take 

yo(£, = 10 sinK)10 sin«) (66) 

and as parameters in the cost function we take Aj = 2 and A2 = g^g. 

We have chosen these numerical values to match as closely as possible the two- 
dimensional example in [10] motivated by thermal manufacturing. The only differ- 
ence is that the pointwisc actuators 8{x — Xi) were approximated in [10] by indicator 
functions of an epsilon environment while we choose here a smoother approximation 
in view of (57). Regarding a direct treatment of 8(x — Xi) as an unbounded control 
operator instead of using the bounded approximation (64), see the comments in 
Section 6. 

The solution of the relaxed optimal control problem (9) has been computed 
numerically. We discretized the state equation (53) in space using a standard 
Galerkin approach with triangular elements and linear Ansatz-functions. We elim- 
inated one control by setting oti(t) = aj(t), i = 1, . . . , N — 1, where we then get 
CKjv(i) = 1 ~ Si^ 1 using the constraint 

JV 

5^ai(t) = l, te[0,i/]. (67) 
i=i 

This constraint is then always fulfilled and the condition 

a N {t)e [0,1], t>t (68) 
is equivalent to imposing that Sj € [0, 1] and 

AT-l 

on - 1 < 0. (69) 

1=1 

The resulting semi-discretized control problem was solved with Bock's direct mul- 
tiple shooting method [2, 13] implemented in the software-package MUSCOD-II. 
The control functions u and a were chosen as piecewise constant and initialized 
with u(t) = and di(t) = ^, t € [0, tf], i = 1, . . . , 8. Assumption (56) thus clearly 
holds. 

The computations were made for an unstructured grid with 162 triangular ele- 
ments and 8, 16 and 32 equidistant shooting intervals. Time integration was carried 
out by a BDF-method and sensitivities were computed using internal numerical dif- 
ferentiation. 



RELAXATION METHODS FOR MIXED-INTEGER OPTIMAL CONTROL OF PDES 15 





Rel. Cost J* = J(u*,a*) 


Mix.-Int. Cost J = J(u*,v*) 


Error -pr\J* - J\ 


1.8750 


5.634024E+04 


1.283813E+05 


2.9809 


0.9375 


4.190360E+04 


7.080185E+04 


1.1955 


0.4688 


3.224914E+04 


6.175488E+04 


0.9149 



Table 1. Performance of the relaxation method for Example 1. 



We implemented Algorithm 1 with adaptively solving the relaxed problem on a 
common control discretization grid Q k for u and a in accordance with Remark 3. 
For the computations, we used bisection for refinements of the control grids Q k in 
step 7:. 

The performance of the relaxation method is summarized in Table 1. We see 
that the relative error of the mixed-integer solution compared with the best found 
relaxed solution decreases with the grid refinements in accordance with Remark 1. 
The best found controls and the evolution of the state norm of the corresponding 
solution are displayed in Figure 1. We see the rounding error in form of an over- 
shooting behavior when comparing the evolution of the L 2 (fl)-norm of the relaxed 
and the mixed-integer solution. This effect decreases with the size of the time dis- 
cretization step size. The cost corresponding to the best found solution is 6175. 
Unfortunately, [10] does not report the cost of the best found solution, but a cu- 
mulative L 2 (0, 15; L 2 (fl))-norm of 90.27. The cumulative L 2 (0, 15; L 2 (fl))-norm of 
our best found solution is 78.58. 

5.2. A semilinear reaction-diffusion system. Let fl be a bounded domain in 
R" with a smooth boundary V and consider the classical Lotka-Volterra system 
with diffusion 




?/i (x, 0) = yi,o (aO, 2/20,0) = yn,o(x) in fl 



with constants a^b^c^di > 0, i = 1,2, domains Q = x [0,f/], E = T x [0, if] 
and control < v(t) < 1. System (70) describes the interaction of two populations 
2/i and 2/2, both spatially distributed and diffusing in fl. The initial distribution 
2/1,0,2/2,0 at t = is assumed to be non-negative. The boundary conditions then 
imply that the populations 2/1 and 2/2 are confined in fl for all t > 0. The function 
v models a control of the system and we shall investigate to approximate optimal 
controls v*(t) taking values in {0, 1} as to minimize the distance of the population 
(2/1,2/2) to its uncontrolled (v = 0) steady state distribution (2/1,2/2) given by the 
constant functions 
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aj(-), «*(•)> • = 5, 



_Q£L 



I 



.fLrU 







n rt 



6 9 
Time i 



12 15 



Ordinary control u*(-) 



40 



20 - 



-20 



-40 



12 15 

















~n 












Time t 



Time t 



Figure 1. Numerical results for Example 1. The upper figures 
show the best found integer controls v*(-) and their relaxation 
&*(•), from bottom to top, i = 1,...,4 (left) and i = 5,..., 8 
(right). Control i>|(-) is defined by v%(t) = 1 - £? =x «*(*), 
t € [0,15]. The lower figures show the corresponding ordinary 
control u*(-) (left) and the evolution of the state norm (right). 



In order to bring the system into abstract form (2), set X = L 2 (il) x L 2 (Vl) 1 
U = U &d = {}, V = R, V &A = {0, 1}, define the operator A: D(A) -> X by 

D(A) = {( Vl ,y 2 ) e ff 2 (fi) x ff 2 (tt) : ^(x,t) = ^(x,t) = 0, on T} 




define the non-linear function f: XxUxV = XxV^Xby 

f((Vi,U2),v)(x) = (y 1 (x)(a 1 - b±v - c 1 y 2 (x)),y 2 (x)(a 2 - & 2 « - c 2 y 2 (x)) 
and define the cost functions 4> and L by 

$((ffi,lto))=0, L((yi,2/ 2 ))= / ||?/i(x)-yi(x)|| 2 + ||y 2 (x)-y 2 (x)|| 2 cfe. 

It is well-known, that (A, -D(vl)) is the generator of an analytic semigroup on 
X and that for any non-negative initial data 2/1,0,2/1,0 G X, the system (70) has 
a non-negative unique mild solution (yi,y 2 ) € C([0,tf], X x X) for every v € 
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Rel. Cost J* = J{u*,a*) 


Integer Cost J = J(u*,v*) 


Error j* |J* - J\ 


2.0000 


7.066392E+01 


8.287875E+01 


0.4065 


1.0000 


5.978818E+01 


6.958250E+01 


0.1809 


0.5000 


5.892414E+01 


5.875641E+01 


0.0028 



Table 2. Performance of the relaxation method for Example 2. 



L°°(0, tf \ [0, 1]). Moreover, for initial data yi t o, J/i,o G this solution is classical 

and satisfies (yi,y 2 ) € C x {[Q,t f ],D(A) x for every v € C°^(0, */; [0, 1]). 

Existence (local in time) and uniqueness follows from classical theory for semilinear 
parabolic equations, see, e.g., [15, Chapter 6]. Global existence results for (70) are 
obtained by a-priori bounds on the solution using contracting rectangles [3] . 

Assume that the initial data satisfies j/i,0)2/i,o € D(A) and that, for some < 
i?< 1, 

a* eC p ° w tf (0,t /; [0,l]) (71) 

is a feasible solution for the relaxed problem (9). 

We can then see that hypothesis (Hi) of Theorem 1 holds, because <f> and L are 
continuous and because it follows from the above well-poscdncss results that the 
sets and 3^2 are bounded. 

Moreover, we claim that hypothesis (H2) of Theorem 1 holds: By analyticity of 
{T(t)}t>o, we have that s almost everywhere in (0,i/), 

±T(t - s)f(y(s), v l ) = —AT(t - s)f(y(s), v*) + T(t - s)f y (y(s), v^s), (72) 

where f y = £-f and y s = j^y. Using that y(s) € D(A) x D(A) for all s <G [0,t/] 
and /: D(A) -> D(A), we see that 

\\-AT{t-8)f{y{a)y)\\x < \\T(t - s)\\ c(x) \\Af(y(s), v*)\\ x < 00. (73) 

Using that / is a smooth function, we see that 

\\T(t - 8)f y (y( 8 ),v i )y a (a)\\x < \\T(t - s)\\ c(x) \\f y (y(s), w*)||x||l/.(*)|U < 00. (74) 

Thus (72) yields the estimate 



±T{t~ S )f{y{s)y) 
as 



< 00 (75) 



A" 



for s £ [0,tf] a. e. 

By well-posedness of the problem (70) for every v € Cp£(Q,tf, [0, 1]), with & 
from assumption (71) we get the estimate 

sup \\f(t,y*(t),v l )\\ x <oo, (76) 
te[o,t/] 

verifying hypothesis (H3). 

Altogether, by Remark 2, we can conclude that Algorithm 1 terminates in a 
finite number of steps with a feasible integer solution v* satisfying the estimate 
\J{v*) — J(a*)\ < e. Again, by Theorem 1, if a* is the optimal solution of the 
relaxed and convexified problem (9), then the integer-gap of a* and the optimal 
integer solution v* is less or equal than e. 

Example 2. We applied Algorithm 1 to a semilinear test problem of the form (70) 
again for a two dimensional domain Q, with the following parameters. 
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Relaxed and integer control Statenorm evolution 




Time t Time t 

Figure 2. Numerical results for Example 2. The left figure shows 
the best found relaxed and integer control £**(•), «*(■) and the right 
figure shows the corresponding evolutions of the populations yi(-), 

l/a(0- 



Let f2 being a circle with radius 1 centered at (1,1) and choose eti = a-2 = 
ci = c-2 = 1, b\ = jq, 62 = |j initial data yi,o, 2/2,0 G ^(-4) approximated by 
2/i,o(£) = |di (a; - 1), 2/2,0 (e) = 1^1 (a; - 1)) where d e (x) given by 

d e (x) = —Le^ (77) 

V 27T6 

models a population concentrated at the origin. For u(i) = 0, £ > 0, the solution 
yi(t,x), y2(t,x) converges asymptotically to a spatially constant and temporarily 
non-constant, periodic solution. 

The computations for the optimal control are made by the same numerical 
method as in the previous example, but using a grid with 258 finite elements. The 
choice of piccewise constant controls ensures that (71) holds with = 1. For the 
performance of the relaxation method implementing Algorithm 1 see Table 2. The 
best found controls and the evolution of the state norm of the corresponding solu- 
tions are displayed in Figure 2. Again we see a decrease of the integer- approximation 
error in accordance with Remark 1. The best found integer control yields a cost of 
58.76. 

6. Conclusions and Open Problems 

We considered mixed-integer optimal control problems for abstract semilinear 
evolution equations and obtained conditions guaranteeing that the solution of a re- 
laxed optimal control problem can be approximated with arbitrary precision using a 
control that satisfies integer restrictions. In particular, our approach is constructive 
and gives rise to a numerical method for mixed-integer optimal control problems 
with certain partial differential equations. Moreover, we showed how these condi- 
tions imply a-priori estimates on the quality of the solution when combinatorial 
constraints are enforced. 

Compared to the results on mixed-integer optimal control problems with or- 
dinary differential equations [18, 16], the setting treated in this paper involves a 
differential operator A, taken to be a generator of a strongly continuous semigroup. 
This requires careful regularity considerations. When A is a Laplace operator, we 
showed on a linear and a semilinear example how such regularity assumptions can 
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be met and provided numerical examples demonstrating the practicability of the 
approach. 

It is clear that the methodology considered in this paper generalizes to the case 
when the generator A of a strongly continuous semigroup is replaced by a family 
{A(t)} te [ _ t ] of unbounded linear operators generating an evolution operator in the 
sense of [12]. On the other hand it is not so clear how to extend the results in case 
of unbounded control action, for example, Neumann or Dirichlet boundary control 
for the heat equation. Recalling the density of solutions to (5) in the set of solution 
to (6) which motivated our approach, we note that the case of unbounded control is 
neither covered by the available results on operator differential inclusions. While in 
principle semigroup techniques can deal with unbounded control operators, see for 
example the exposition in [1, Chapter 3], this extension is non-trivial and requires 
additional work. 
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